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ABSTRACT 


An  adaptive  guidance  law  of  a  Vision  Based  Target  Tracking  (VBTT) 
system  was  previously  developed  and  implemented  onboard  a  Small  Unmanned 
Aerial  Vehicle  (SUAV)  in  order  to  track  a  ground  target  moving  with  a  constant 
velocity.  This  work  extends  previous  results  by  considering  scenarios  where  the 
variation  of  target  velocity,  in  both  magnitude  and  direction,  is  used  to  excite  the 
feedback  control  law  for  further  robustness  analysis.  This  provides  essential 
insight  on  the  sensitivity  of  the  performance  criteria  indicated  by  the  range 
holding  capability,  navigation  error  and  the  convergence  speed  of  the  guidance 
law. 

In  addition,  this  thesis  addresses  the  robustness  of  the  SUAV  guidance 
law  to  the  generalized  time  delay  in  feedback  due  to,  for  example,  data 
processing  or  communications  lag.  This  thesis  also  extends  the  previously 
obtained  results  by  introducing  a  multi-criteria  optimization  technique.  The  results 
obtained  are  first  based  on  the  numerical  simulations  implemented  in  SIMULINK 
and  then  in  high  fidelity  HIL  simulation  environment  with  Piccolo  Plus  AP  in  the 
control  loop. 

Initial  steps  in  developing  Vision  Based  HIL  environment  incorporating 
TASE  gimbal,  Piccolo  Plus  AP,  Pan-Tilt  unit  and  image  processing  software  are 
presented.  The  work  also  includes  motivation  for  the  development,  an  overview 
of  the  existing  technologies,  and  initial  implementation  of  low-level  driving 
mechanism  (drivers)  for  the  realistic  representation  of  the  real-world 
environment. 
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I.  INTRODUCTION 


A.  BACKGROUND 

Since  the  turn  of  the  millennium,  many  military  and  security  forces  around 
the  world  have  been  modernizing  their  equipment  and  operating  platforms  in 
preparation  for  future  network  centric  warfare  concepts.  Coupled  with 
technological  advances  in  communications,  solid-state  sensors  and  power 
supplies,  this  modernization  resulted  in  an  unprecedented  use  of  Unmanned 
Aerial  Vehicles  (UAVs)  in  modern  battlefield.  Used  predominantly  in  the  areas  of 
intelligence,  reconnaissance,  surveillance,  battle  damage  assessments  and 
target  tracking  missions,  UAVs  are  able  to  operate  in  all  weather  conditions  and 
environments  and  offer  better  endurance  and  persistence  over  human 
deployment. 

For  the  US  military  in  particular,  the  wars  in  Afghanistan  and  Iraq  further 
saw  the  usage  of  UAVs  across  the  U.S.  military  network  as  a  whole  leap  to 
258,000  hours  in  2007.  This  number  is  expected  to  surge  to  300,000  hours  in 
2008. 1  Faced  with  the  ever  growing  demand  for  actionable  intelligence  in  an 
evolving  battlefield,  human  operators  of  UAV  will  inevitably  need  to  multi-task 
and  work  harder  in  order  to  control  autonomous  platforms,  process  and  deliver 
timely  information. 

To  aid  in  this  information  management  process,  a  fully  autonomous 
unmanned  aerial  platform  will  be  indispensable  to  enhance  the  effectiveness  of 
UAV  operations  and  to  allow  more  spare  capacity  to  the  human  operator. 
Sophisticated  target  detection  and  a  vision  based  tracking  algorithm  have  been  in 
active  development  in  order  to  address  this  need.  The  key  task  at  hand  then 


1  Armed  Forces  International,  “US  Military's  UAV  Missions  Increasing” 
http://www.armedforces-int.com/news/2008/01/02/us-militarys-uav-missions-increasinq.asp. 

[Accessed  Nov  08]. 
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becomes  the  integration  of  the  maturing  hardware  technologies  and  the 
advanced  guidance  and  control  algorithms  to  truly  achieve  the  goal  of  unmanned 
autonomous  surveillance. 

B.  OVERVIEW  OF  THE  RESEARCH  PROJECT 


This  thesis  is  part  of  an  ongoing  effort  within  the  Unmanned  Systems 
Research  Group  at  the  Naval  Postgraduate  School  (NPS)  to  build  a  Vision  Based 
Target  Tracking  (VBTT)  simulator  system  in  a  laboratory  environment. 


Figure  1 .  NPS  Small  UAV,  Sig  Rascal 

This  VBTT  simulator  system  will  imitate  actual  UAV  flight  dynamics  of  a 
small  UAV  seen  above  in  Figure  1 .  This  provides  an  ideal  research  and 
development  and  training  tool  that  can  be  used  in  the  lab.  The  key  benefit  of  this 
setup  is  that  it  will  greatly  facilitate  the  development,  integration  and  testing  of 
new  vision-based  target  tracking  software  and  guidance,  navigation  and  control 
(GNC)  algorithms  in  a  safe  laboratory  environment.  It  will  considerably  reduce 
the  likelihood  of  a  failure  by  detecting  bugs  and  deficiencies  before  the  tactical 
UAV  aircraft  is  put  at  risk  in  an  actual  flight  test. 

The  VBTT  simulator  system  is  an  elaborate  setup  that  comprises  both 
hardware  and  software  components.  The  principal  functions  of  the  various 
components  are  briefly  described  as  follows: 
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1 .  Piccolo  Autopilot  (AP)  System  -  The  AP  system  together  with  the 
6-DOF  flight  simulator  application  provides  simulated  flight  dynamics  inputs  to 
the  GNC  algorithm  that  is  used  to  drive  the  motion  of  the  UAV. 

2.  Six  Degree  of  Freedom  (DOF)  Flight  Model  -  Is  used  to  provide 
simulated  flight  dynamics  in  a  test  environment. 

3.  Pan-Tilt  Unit  (PTU)  -  Is  used  to  simulate  the  aircraft  dynamics  for 
an  onboard  gimbal  in  flight  condition  and  is  driven  by  the  commands  from  the  AP. 

4.  TASE  Gimbal  -  The  TASE  gimbal  is  a  small  inertially  stabilized 
gimbal  with  an  onboard  GPS  and  IMU  for  standalone  operations.  It  is  the  first 
image  capturing  device  in  the  VBTT  setup  and  is  mounted  on  the  PTU  unit.  The 
imagery  captured  by  the  TASE  gimbal  is  subsequently  transmitted  to  the  ground 
where  it  is  processed  by  the  automated  motion  tracking  software. 

5.  Motion  Tracking  Software  -  The  automated  motion  tracking 
software  is  developed  by  PerceptiVU  Inc.  Once  the  user  selects  the  target  of 
interest,  the  software  is  used  to  track  the  target  automatically  without  any  further 
user  intervention. 

6.  GNC  Algorithm  -  The  algorithm  [1]  solves  two  principal  tasks. 
First,  it  autonomously  navigates  the  UAV  around  the  target  while  keeping  the 
target  in  the  camera  frame.  Second,  it  controls  the  gimbaled  camera  installed 
onboard  so  that  when  the  vision-based  tracker  is  engaged,  the  target  is  kept  in 
the  center  of  the  camera  frame.  The  target  motion  estimation  error  is  minimized 
when  the  target  moves  parallel  to  the  camera  image  plane. 

This  control  strategy  used  in  the  development  of  the  guidance  law  is 
depicted  in  Figure  2  [1],  It  illustrates  a  2-D  shape  of  an  SUAV  orbit  above  the 
target,  while  the  UAV  is  autonomously  guided  to  accomplish  the  task  of  target 
tracking.  The  guidance  algorithm  controls  the  orientation  of  the  UAV  ground 
speed  vector  Vg  to  make  it  continuously  perpendicular  to  the  line  of  sight  (LOS), 
where  the  LOS  is  the  line  connecting  the  UAV  and  the  target. 
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Figure  2.  Conceptual  Representation  of  VBTT  Guidance 


C.  SCOPE  AND  OBJECTIVES 

The  objective  of  this  thesis  is  to  further  investigate  the  robustness  of  the 
developed  guidance  law  to  the  variations  of  target  escape  maneuver  and  to 
develop  and  integrate  several  components  required  for  a  Hardware-ln-The-Loop 
(HIL)  simulation.  The  scope  of  work  is  as  follows: 

•  Investigate  performance  of  the  guidance  control  law  subject  to  a  target 
escape  maneuver. 

•  Develop  and  integrate  new  adaptive  control  law  into  the  existing  6-DOF 
UAV  flight  dynamics  model  and  implement  it  on  a  PC/104  form  factor 
computer. 

•  Develop  all  the  necessary  software  drivers  and  integrate  the 
corresponding  hardware  components  required  for  HIL  simulation. 

•  Perform  real-time  HIL  simulation  of  the  adaptive  control  law  and  prove  its 
feasibility  for  further  flight  implementation. 
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II.  DEVELOPMENT  OF  CONTROL  LAW 


A.  COORDINATE  SYSTEMS 

Multiple  coordinate  frames  are  often  used  to  define  the  kinematics  motion 
and  behavior  of  an  object  in  complex  dynamic  systems.  Hence  the  translational 
and  rotational  kinematics  states  (i.e.  the  positions,  velocities,  and  accelerations) 
of  the  objects  can  be  fully  described  in  any  frame  as  long  as  the  transformation 
relationships  between  the  coordinate  frames  are  known.  The  following  coordinate 
systems  were  used  in  the  development  of  the  control  law  in  this  thesis  [2]  -  [6], 

1.  Navigation  Inertial  Coordinate  Frame  (I  -Frame) 

This  local  level  frame  assumes  a  flat  earth  model  in  the  vicinity  of  the 
reference  navigation  point:  it  has  Xn  -  Yn  axes  in  a  plane  tangent  (known  as 
Local  Tangent  Plane,  LTP)  to  the  reference  point  origin  on  the  earth  ellipsoid 
surface,  and  the  Zn  axis  perpendicular  to  that  ellipsoid  surface.  It  is  assumed  that 
the  Xn  axis  points  north,  the  Yn  axis  east,  and  the  Zn  axis  down.  This  is  a  north¬ 
east-down  (NED)  coordinate  system  and  complies  with  the  right-hand  rule  as 
illustrated  in  Figure  3. 


North 


Figure  3.  NED  Coordinate  System 
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2. 


SUAV  Body  Coordinate  Frame  (B  -  Frame) 


A  convenient  coordinate  system  for  developing  the  equations  of  motion  of 
the  SUAV  is  a  right-hand  orthogonal  system  with  its  origin  centered  at  the  aircraft 
center  of  gravity.  Conventionally,  the  x-axis  points  forward  along  the  longitudinal 
axis  of  the  aircraft,  the  y-axis  points  outwards  towards  the  right  wing,  and  the  z- 
axis  is  in  the  downward  direction  as  seen  in  Figure  4. 


x 


Figure  4.  UAV  Body  Coordinate  Frame  (B  -  Frame) 


3.  Gimbal  Platform  Coordinate  Frame  (G  -  Frame) 

The  gimbal  coordinate  frame  is  a  right-hand  orthogonal  coordinate  system 
with  the  origin  being  the  location  of  the  camera  mount.  The  x-axis  of  the  gimbal 
frame  points  forward  along  the  longitudinal  axis  of  the  gimbal  platform,  the  y-axis 
points  outward  toward  the  right-hand  side,  and  the  z-axis  points  downward  from 
the  gimbal  platform. 

4.  Camera  Coordinate  Frame  (C  -  Frame) 

The  camera  coordinate  frame  is  a  right-hand  orthogonal  coordinate 
system  with  the  origin  located  at  the  focal  point  of  the  camera.  The  x-axis  points 
forward  along  the  longitudinal  axis  of  the  camera,  the  y-axis  points  outwards 
toward  the  right-hand  side,  and  the  z-axis  points  downward  from  the  origin. 
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5. 


Image  Plane  Coordinate  Frame  (P  -Frame) 


The  image  plane  reference  frame  is  the  coordinate  system  used  to 
describe  the  location  of  the  target  in  the  image  plane.  It  is  a  2-dimensional 
coordinate  system  with  the  u-axis  aligned  with  the  y-axis  of  the  camera 
coordinate  frame,  and  the  v-axis  aligned  with  the  negative  z-axis  of  the  camera 
coordinate  frame. 

B.  EULER  ANGLES 

Euler  angles  are  the  classical  way  of  representing  rotations  in  3- 
dimensional  Euclidean  space.  The  triplet  of  Euler  angles  relates  two 

orthogonal  coordinate  systems  having  a  common  origin  and  the  coordinate 
frames  can  be  transformed  to  the  other  through  a  series  of  rotations  defined  by 
the  Euler  angles.  Conventionally  when  the  Euler  angles  [j),d,y/) are  used  to 

describe  the  orientation  of  the  aircraft  body  in  relation  to  the  inertia  frame,  these 
Euler  angle  are  known  as  roll,  pitch  and  yaw  respectively  and  are  shown  in 
Figure  4  [2],  [3],  [4], 

C.  RELATIONSHIPS  BETWEEN  COORDINATE  FRAMES 

A  coordinate  transformation  is  a  conversion  from  one  coordinate  system  to 
another,  to  describe  the  same  object.  A  rotation  is  a  type  of  transformation  from 
one  system  of  coordinates  to  another  system  of  coordinates  such  that  the 
distance  between  any  two  points  remains  invariant  under  the  transformation.  A 
rigid  body  position  in  space  can  be  represented  by  a  [3  x  1]  vector,  and  its 
orientation  to  its  own  current  coordinate  frame  or  a  transformed  coordinate  frame 
can  be  uniquely  described  by  a  [3  x  3]  rotation  matrix  at  any  instant  in  time  [2], 
[3], 
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1. 


Rotation  Matrices 


The  rotation  matrices  for  a  single  2-dimensional  rotation  about  each 
individual  axis  are  given  below.  The  angle  of  rotation  is  the  Euler  angle  that 
corresponds  to  each  individual  axis. 


“l  0 

0 

R,  W 

0  cos(^) 

sin(^) 

0  -sin(^) 

cos(^) 

cos(6*)  0 

i 

t/i 

i 

R,{0) 

0  1 

0 

sin(6*)  0 

cos(6*) 

cos(^)  sin(^)  0 

R2(y) 

-sin(^)  cos(^)  0 

0 

0  1 

(1) 

(2) 

(3) 


The  complete  rotation  or  transformation  of  the  coordinate  system  is  the 
sequential  combination  of  the  2-dimensional  rotations  about  each  axis.  The 
sequence  or  order  of  the  rotation  is  important  to  properly  define  the  orientation  of 
the  body  and  to  preserve  the  orthogonality  of  orientation  (right-hand  system  or 
left-  hand  system)  of  the  transformed  axes. 


2.  Coordinates  Transformation 


The  coordinate  transformation  or  rotation  from  the  inertia  frame  to  the 
camera  frame  can  be  obtained  via  sequential  coordinate  rotation  from  one  frame 
to  the  other  in  the  correct  logical  order  as  shown  below: 


C  n  _  C  D  G  n  B  r> 
jK  —  gK  bK  jK 


(4) 


where  i:,R  is  the  coordinate  rotation  from  inertia  frame  to  body  frame 

).'/?  is  the  coordinate  rotation  from  body  frame  to  gimbal  frame 
((i  R  is  the  coordinate  rotation  from  gimbal  frame  to  camera  frame 
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a.  Inertial  Frame  to  Body  Frame  Transformation 

The  coordinate  transformation  from  the  inertial  frame  to  the  body 
frame  is  simply  the  product  of  the  three  individual  rotation  matrices: 

‘R  =R,(%)R,('eB)R!(‘v.)  (5) 

b.  Body  Frame  to  Gimbal  Platform  Frame  Transformation 

The  coordinate  transformation  from  the  body  frame  to  the  gimbal 
platform  frame  only  involves  rotation  through  two  angles  because  the  gimbal 
platform  is  a  two-axis  coordinate  system.  There  is  no  rotation  along  the  x-axis 
(roll  rotation)  and  hence  the  roll  angle  is  taken  to  be  zero.  The  gimbal  platform 
frame  will  be  rotated  along  the  y-axis  (pitch  rotation)  and  the  z-axis  (yaw  rotation) 
as  shown  in  the  following  rotation: 

1R  =R,\%)R-.{‘Vg)  (6) 

c.  Gimbal  Platform  Frame  to  Camera  Frame 
Transformation 

The  coordinate  transformation  between  the  gimbal  platform  frame 
and  the  camera  frame  allows  for  any  misalignment  angles  that  exist  between  the 
mounting  of  the  camera  platform  with  the  gimbal  platform.  In  most  likelihood, 
some  or  all  of  the  rotation  angles  will  be  zero  because  the  axes  will  be  directly 
aligned: 


cgr  =Rx{%)Ry(Gec)Rz{Gwc) 


(?) 
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d.  Camera  Frame  to  Image  Plane  Frame  Transformation 

The  coordinate  transformation  between  the  camera  frame  and  the 
image  plane  frame  is  not  a  rotational  but  a  positional  transformation.  The  position 
[u,  v]  of  an  object  in  the  image  plane  frame  from  a  position  in  the  camera  frame  is 
given  as  below  and  is  also  seen  in  Figure  5. 


It  is  of  interest  to  note  that,  unlike  the  previous  rotational 
transformations,  the  camera  to  image  plane  transformation  is  irreversible.  This  is 
due  to  the  transformation  of  a  three-dimensional  coordinate  system  to  a  two- 
dimensional  coordinate  system. 


CZ 

Figure  5.  Image  Plane  Reference  Frame 
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3.  Angular  Velocities  Transformations 


a.  Body  Frame  Angular  Velocities  with  Respect  to  Inertia 
Frame 


The  angular  velocity  vector ,  in  the  body  fixed  coordinates  system 
of  the  SUAV,  has  components  [p,  q,  r]  in  the  x,  y  and  z  direction  respectively.  The 
relationships  with  the  Euler  angle  rates  \J)B,  0B,  yr B ]  for  which  are  stated  as 
follow: 


1 

o  o 

_ 1 

© 

_ 1 

+  Rx  (  Vs  ) 

o  5^- 
_ 1 

¥b\ 

0 

0 

Pb 

v, + 4 + k 

0b-Vb  sin 

B 

COBi  — 

= 

qB 

= 

Vy+Qy+<i>y 

= 

\j/B  cos  '0B  sin  '(f>H  +  6b  cos  ‘<j)B 

_0):\ 

Jb  \ 

yz+oz +</>zj 

\j/B  cos  '0B  sin  ‘(j)B  -  0 B  cos  ‘(j)B 

Expressing  <j>B,0B,  y/B  in  terms  of  [pB,  qB,  rB]  below,  we  observe  the  singularity 


problem  in  Equation  (10)  when  ^,=±90°: 


Wb 

4 

4 


(in  \\  q*  sin(V«)  +  ^COs(  Vj 

cos  I  dB  lL  - 

qK  cos(  Vfl)-rBsin( 

Pb  + tan ( 'dB )\_qB  sin (  V«)  +  rB  cos ( ‘</>B ) 


(10) 


b.  Gimbal  Frame  Angular  Velocities  with  Respect  to  Inertia 
Frame 

The  angular  velocities  of  the  gimbal  frame  with  respect  to  the  inertia 
frame  are  shown  below.  Equation  (10)  relates  the  angular  velocity  expressed  in 
the  gimbal  platform  frame  while  Equation  (1 1)  describes  the  transformation  of  the 
same  angular  rate  in  the  inertia  frame: 
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Pg 

Pb 

"  0  " 

"  0  " 

i 

>! 

1 _ 

=  Ry(%)R;('r„) 

qB 

Jb  _ 

+  *,('*«)*■(  Vo) 

0 

Wg  \ 

o 

1 _ 

JcoG[  =  gbR 


CO, 


GI 


Pb 

"  o " 

"  0  " 

qB 

+  bR 

0 

+B-X  e«) 

4 

Jb  _ 

Wg. 

0 

Pg 

COGi 

=  gR 

qG 

Jg  _ 

(11) 


(12) 


c.  Gimbal  Frame  Angular  Velocities  with  Respect  to  Inertia 
Frame 


If  the  camera  frame  is  perfectly  aligned  with  the  gimbal  platform 
frame,  then  there  will  be  no  rotation  between  the  two  frames.  Therefore  the 
angular  rates  between  the  two  frames  will  be  the  same.  The  relationships  are 
expressed  below: 


C.,  -  cz?G^ 

®  CI  G  R  ®  GI 


(QCi  coGI 


Pg 

Qg 


rG 


coa  coG1 


.  c 

’  G 


R=I 


(13) 

(14) 


D.  KINEMATICS  EQUATIONS  OF  THE  SUAV-TARGET  RELATIVE 
MOTION 


A  2-D  simplified  representation  of  the  kinematics  relationships  between 
the  SUAV  and  target  motion  is  required  as  a  prerequisite  to  the  development  of 
the  guidance  control  law  as  shown  in  Figure  6.  It  is  assumed  that  an  autopilot  is 
capable  of  maintaining  level  flight  of  the  UAV  and  the  onboard  2-axis  gimbal  is 
inertially  stabilized.  This  justifies  the  formulation  of  the  target  tracking  and  UAV 
control  tasks  in  a  horizontal,  2-D  plane.  The  following  figure  depicts  the 
kinematics  relationships  between  the  angles  used  to  characterize  relative  motion 
of  the  SUAV-Target  system  [1],  [5], 
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rt i  =  navigation  error  i// 

a  =  camera  LOS  Pan  error  y/t 

A  =LOS  angle  in  inertia  frame  y/h 

Ag  =  LOS  vector  Vg 

Xn  =  Normal  to  LOS  vector  Vf 


=  UAV  heading  in  inertia  frame 
=  Targetheadingin  inertia  frame 
=  Camera  angle  in  UAV  body  frame 
=  SUAV  ground  speed  in  inertia  frame 
=  Target  ground  speed  in  inertia  frame 


Figure  6.  Kinematics  of  the  SUAV  -  Target  Motion 


The  following  set  of  basic  kinematical  relations  is  derived  directly  from  the 
kinematics  of  Figure  6.  It  is  first  observed  that: 


13 


(15) 


7  =  t/-(A--|) 

Next,  projecting  the  UAV  and  target  speed  vectors  onto  the  LOS  results  in  the 
time  derivative  of  the  horizontal  range  to  the  target 

p  =  -V  sin/7  +  Vt  sin (i//t  -  (iff-  if )) . 

Similarly,  projecting  the  same  vectors  onto  the  line  orthogonal  to  the  LOS 
produces  the  rotation  speed  of  the  LOS 

j  _  vs  cos a  K  cos(^  -iv-  n))  (16) 

p  p 

Finally,  an  expression  for  the  tracking  error  s  is  given  by 

e  =  X-y/-y/h  (17) 

Substituting  Equation  (17)  into  time  derivatives  of  Equations  (15)  and  (16) 
produces  the  following  set  of  equations  describing  the  kinematics  of  the  tracking 
problem: 

V  cos rj-Vt  cos(^,  -  (ip  - 7)) 

77  =  — - 1 -\j/ 

P 

V  cos  T/-Vt  cos (y/  -  (ip  -  r/)) 

£  =  — - V-Vk 

P 

p  =  -Vgsmrf  +  Vtsm(if/l  -(yz-rf))  (18) 

The  navigation  angle  error  7  is  the  angle  subscribed  between  the  SUAV’s 
ground  velocity  vector  and  the  perpendicular  to  LOS  vector.  The  navigation  angle 
error  will  approach  zero  when  the  SUAV  has  established  a  circular  orbit  about  a 
stationary  target  at  the  desired  range. 

The  camera  LOS  angle  error  s  is  the  angle  between  the  camera  LOS 
vector  (camera  optical  middle  line)  and  the  line  connecting  the  camera  and  the 
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target.  The  objective  of  the  gimbal  control  law  is  to  drive  this  angle  to  zero  by 
using  a  feedback  of  the  image-based  tracking  software. 

E.  CONTROL  LAW  DESIGN 

The  control  objective  is  to  drive  rj  and  a  to  zero  using  the  SUAV  turn  rate 
\j/  and  gimbal  pan  rate  \j/h  commands  as  control  inputs.  To  achieve  this,  the 

control  laws  for  implementation  on  the  SUAV  autopilot  controller  and  gimbal 
platform  controller  are  as  shown: 

Vg 

If 7  =—  COS  77-^77 

Pd 

Yh  =Kxrf  +  K2s 

rf  =  Navigation  angle  error 

a  =  Camera  LOS  angle  error 

Vg  =  SUAV  ground  speed 

K  K.  =  Gain  constants 
1,  z 

The  chosen  form  of  control  law  in  Equation  (19)  allows  for  dynamic 
adjustment  of  the  required  turning  bias  of  the  SUAV,  \j/  in  accordance  to  the 
magnitude  of  the  ground  velocity  vector  of  the  SUAV  to  converge  to  the  desired 
range  pd .  For  a  stationary  target,  if  the  SUAV  starts  tracking  a  target  at  a 

distance  smaller  than  commanded  range,  it  will  spiral  outwards  to  the  desired 
range;  if  the  SUAV  starts  tracking  a  target  at  a  distance  larger  than  the 
commanded  range,  it  will  spiral  inwards  to  the  desired  range.  When  the  SUAV 
flight  is  established  at  its  desired  range  in  a  circular  orbit,  the  turn  rate  of  the 
SUAV  will  approach  the  required  turning  “bias”  that  will  keep  the  SUAV  in  the 
circular  orbit  about  the  target  at  the  commanded  range.  The  gimbal  turn  rate  of 
the  gimbaled  camera  will  also  approach  zero  when  the  SUAV  has  established 
the  +/-  90°  camera  LOS  angle  in  the  circular  orbit  at  the  desired  range. 


(19) 

y/  =  UAV  turn  rate  in  inertia  frame 

(//[-,  =Camera  turn  rate  in  UAV  body  frame 
pj  =  Desired  range 
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The  feedback  system  consisting  of  Equations  (18)  and  (19)  is  given  by 
System  (20)  as  follows: 

l 7  =  -V  p e  cos  r/  -kxri  +  Vtcos{ri  -y/)p 

s  =Vgpecosri-k2£-Vtcos{ri-y/)p 
pe  =  p2Vg  sin  rj  -  Vt  sin(?7  -  y/)p2 

where  pe= - ;  pe  = - 2p;  p  =  pe+ —  (20 

P  Pd  P  Pd 

From  System  (20),  it  can  be  observed  that  by  driving  the  navigation  angle 
error,  77  and  camera  LOS  angle  error,  s  to  zero,  the  range  error  pe (range  to 

target)  which  is  not  observable  but  controllable,  is  indirectly  driven  to  zero  for  a 
stationary  target. 

F.  LYAPUNOV  STABILITY  ANALYSIS  OF  THE  FEEDBACK  SYSTEM 

For  stability  analysis,  it  is  convenient  to  rescale 77  by  introducing  a  new 
state  variable  fj  =  rjlpd  and  substituting  into  Equation  (20): 

77  -Vgpe  cos  fjpd  -  kfjpd  +  Vt  cos(fjpd  -  y/)p 

*  ■=  Pe  =  P2  Vg  sin  VPd  ~  Vt  cos(f]pd  -  y/)p2  (21) 

L  VsPe cos  {lPd  -  k2£  -  K  cos(?7/7rf  -  y/)p 

where  x  =  [77  pe 

Using  eigenvalue  analysis,  the  stability  of  the  system  in  Equation  (18)  is 
addressed  next.  If  we  first  assume  that  the  target  is  stationary  and  therefore 
Vt  =0  then: 

77  ~^gPe  cos  VPd  -k{hpd 

x:=  pe  =  p2Vg  sin  fjpd  ,  (22) 

L  V%Pe  C0S  ^IPd  ~ki8 

and  the  origin  x  =  (0  0  0)  is  clearly  the  equilibrium  of  Equation  (19).  Linearization 
of  Equation  (22)  around  the  origin  yields  an  LTI  system: 
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(23) 


~K  ~VJ  Pa  0 

|=  vg/Pd  o  o  4 

o  vg  -k2_ 

We  may  also  assume  also  that  the  SUAV  velocity  Vg  is  constant 
and  VeVa  ,V„  ,V„  >V„  >0.  Then  the  eigenvalues  of  the  state  matrix  in 

Equation  (23)  have  negative  real  parts  for  any^>0,  kn>  0.  Therefore,  the 
nonlinear  system  in  Equation  (22)  is  locally  asymptotically  stable  for 

anyAj  >0,  k2>  0  . 

On  the  other  hand,  if  target  is  moving  and  Vt  ^0,  the  equilibrium  of 

Equation  (21)  is  at  the  relative  heading  ¥  =  This  in  fact  corresponds  to  the 

circular  motion  of  the  SUAV  around  the  target.  In  this  case  linearization  of 
Equation  (21)  around  the  equilibrium  results  in  an  LTI  system 

~K+vt/  Pd  -vg/Pd  o 

f,=  {V'-V,)lp<  0  o  (24) 

-V,  V,  ~*2_ 

The  target  velocity  Vt  is  assumed  constant 

andKefv,  ,V.  ],  V,  >K  > 0 .  The  eigenvalues  of  the  LTI  system  in  Equation 

1  L  <m>n  <max  _l  *max  <m'n 

(21 )  will  have  negative  real  parts  if  Vg>Vt,  kx>Vtlpd  and  A:2  >  0 . 

The  plots  of  the  state  trajectories  of  the  system  in  Equation  (20)  in 
response  to  a  number  of  initial  conditions  are  included  as  follows: 
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Figure  7.  Steady  State  T rajectories 


In  Figure  7,  the  plot  on  the  left  illustrates  the  impact  of  increasing  the 
gainst, ,  k2. for  a  fixed  V,or\  the  trajectories  of  the  feedback  system  in  Equation 

(20).  Conversely,  the  plot  on  the  right  demonstrates  the  influence  of  increasing  Vt 
for  fixed  kx  and£2.  The  figures  show  that  the  trajectories  of  feedback  system  in 
Equation  (20)  converge  to  a  ball,  the  size  of  which  is  proportional  to  Vt  and 
inversely  proportional  to  kx  and&,  [1]. 
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III.  IMPLEMENTATION  OF  CONTROL  LAW 


A.  CONTROL  SYSTEM  ARCHITECTURE 

The  control  law  that  will  be  implemented  is  shown  in  Equation  (25)  and  the 
control  system  architecture  that  implements  the  control  laws  is  presented  in 
Figure  8. 

VK 

if/  =  — —  cos  ?i  —  K\ij 

Pc 

¥  h  =K\?j  +  K2£  (25) 


Onboard  cameras  provide  real-time  imagery  to  the  image  tracking 
software  and  the  software  computes  the  tracking  errors,  while  the  onboard  GPS 
and  inertial  systems  provide  solution  for  the  navigation  error  77.  In  turn,  if/  and 
if/ h  are  computed  and  these  yaw  rates  drive  the  autopilot  and  the  gimbal 
respectively. 


Compute 

n 

VB 

¥  t 

NPS  Autopilot 

<-lc  >  \ 

1  T  A  ^  7 

UA\ 

n-  e 

£ 

Control 

Gimbal 

CCD  Camera 

V'i 

Tnrgt'i  position  in  the 

fj  \ 

Image 

camera  frame 

Trackmg 

Analog  xideo 


Figure  8.  Control  System  Architecture 

The  control  law  for  the  gimbal  camera  yaw  command  if/h  in  Equation  (25) 

is  implemented  in  the  SIMULINK  between  the  “Gimbaled  Camera  model”  and 
“CurGuid  Controller”  block  [5]  as  shown  in  Figure  9. 
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Figure  9.  VBTT  SIMULINK  Model  Schematics 

The  control  law  for  the  SUAV  yaw  rate  command  if/  in  Equation  (25)  is 
implemented  in  the  “CurGuid  Controller”  block,  as  shown  in  Figure  10.  in  the 
VBTT  SIMULINK  model  schematics  [5], 
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Figure  10.  SIMULINK  CurGuid  Controller  Block 


B.  SIMULATION  RESULTS 

The  performance  of  the  existing  control  law  was  previously  tested  against 
a  stationary  target  and  a  moving  target  under  different  target  motion  scenarios 
[5],  From  these  experiments,  the  sensitivity  results  of  the  new  control  law  are 
derived  for  various  parameters  of  feedback  control  gain  K-i,  and  the  relative 

V 

velocity  ratio  of  the  target  and  SUAV  velocities,  — . 

Vg 

The  analysis  presented  herein  generalizes  the  previous  results  and  further 
investigate  the  robustness  of  the  control  law  to  the  variation  of  control  gain  Ki 
with  different  target  maneuver  scenarios.  As  the  parameter  K2  only  partially 
affects  the  gimbai  control  law  equation  ( \j/h  =  k^j  +  k2s),  K2  is  not  examined  for 

the  cross  coupled  sensitivity  between  the  SUAV  turn  rate  command  and  the 
camera  LOS  turn  rate  command.  The  scenarios  used  for  analysis  are  as  follows: 


21 


•  Scenario  A:  Stationary  target. 

•  Scenario  B:  Target  is  moving  with  a  nominal  speed  (8m/s)  with  a 
constant  heading. 

•  Scenario  C:  Target  is  moving  with  a  nominal  speed  (8m/s)2  with 
variable  heading. 

In  addition,  the  three  major  error  components  of  a  SUAV  tracking 
performance  namely:  navigation  error,  r|,  camera  LOS  yaw  error,  s  and  relative 
range  holding  error,  p*  are  numerically  calculated  and  analyzed.  Relative  range 
holding  error,  p*  is  a  measure  of  the  SUAV  range  holding  capability  and  is 
defined  by  the  ratio  of  the  range  error,  perr  to  the  range  desired,  pd.  These  three 
error  components  are  assumed  independent  of  each  other.  Their  steady  state 
time  averaged  values  are  measured  for  different  values  of  feedback  gain,  Ki.  It  is 
therefore  desired  to  obtain  a  value  of  Ki  such  that  it  minimizes  all  the  error 
components  simultaneously.  For  the  purpose  of  multi-criteria  optimization,  a  new 
measure  of  performance  (MOP),  Mi  is  introduced  as  a  square  root  of  the  sum 
squares  of  the  three  independent  error  components.  This  choice  of  the  MOP  is 
motivated  by  the  fact  that  each  Ki  can  be  represented  by  a  point  in  a  3- 
dimensional  (3-D)  space  of  errors  {r|,  p*,s}  with  a  control  objective  to  minimize  all 
of  them  simultaneously.  This  corresponds  to  the  search  for  a  Ki  such  that  the 
distance  from  the  origin  of  the  3-D  errors  space  is  minimized  as  graphically 
shown  in  Figure  1 1 .  This  can  be  represented  for  a  hypothetical  distribution  of  {rj, 
p*,  s}  versus  Ki  as  shown  in  Equation  (26): 


2  Vt  =  8m/s  is  chosen  because  it  exhibits  sensitivity  to  the  different  target  maneuver 
scenarios. 
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(26) 


M,  =  \j/j2  +  s2  +  p  *2 


8 


Figure  1 1 .  Intuitive  Motivation  of  Multi  Objective  Optimization 
of  Three  Independent  Criteria  {r\,  p*,s} 


Finally,  the  robustness  of  the  SUAV  control  law  is  also  investigated  by 
considering  generalized  time  delay  in  the  feedbacks  due  to  for  example  data 
processing  or  communications  lag.  Therefore  the  target  maneuver  scenarios  are 
extended  as  follows: 
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o  Scenario  A1:  Target  is  stationary  with  different  values  of  time 
delay. 

o  Scenario  Cl:  Target  is  moving  with  a  nominal  speed  (8m/s)  with 
varying  heading  and  different  values  of  time  delay. 

1.  Sensitivity  Analysis  of  Measure  of  Performance  to  Variations 
of  Gain  Ki  for  Scenario  A:  Stationary  Target 

The  sensitivity  analysis  of  the  measure  of  performance,  Mi  to  variations  of 
gain  Ki  is  examined  in  a  scenario  where  the  target  is  stationary  and  the 
commanded  range  is  300m.  This  scenario  is  chosen  as  a  baseline  model  for 
further  comparison  with  other  target  maneuver  scenarios.  The  initial  conditions 
are:  (1)  SUAV  velocity  =  28  m/s;  (2)  target  velocity  =  Om/s;  (3)  initial  position  of 
the  SUAV  is  at  [0,  -1000,  300];  (4)  initial  position  of  the  target  is  at  [0,  0,  0]  and 
(5)  K2  =  0.20.  Figure  12  shows  the  variation  of  r|,  p*,  s  and  Mi  with  variations  of 
gain  K-i  for  Scenario  A  while  Figure  13  shows  the  error  dynamics  for  the  optimal 
case  of  Ki  =  0.500. 

The  following  observations  can  be  made  from  the  plots: 

(a)  From  Figure  12,  it  is  observed  that  the  relative  range  holding  error, 
p*  increases  with  increasing  Ki.  This  is  accompanied  by  a  corresponding 
decrease  in  the  77  and  s  errors,  resulting  in  an  overall  decrease  of  Mi . 

(b)  From  Figure  13,  it  follows  that  the  increasing  of  Ki  extends  the 
settling  time. 
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Scenario  A:  Stationary  Target 
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Scenario  A:  Ki  =  0.500  (Optimal  Case) 


SUAV  target  VBTT  control  law  tracking  history 


Plot  of  UAV  and  Target  Track 


East,  Y  (m) 


Range  convergence  history  of  the  SUAV  to  the  desired  range  of  300m 


Plot  of  UAV  Target  Range  Tracking  Performance 
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Pan  /  Tilt  angles  convergence  history  and  gimbal  camera  angle  errors 
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Figure  13.  Sensitivity  Analysis  for  Ki  =  0.500  for  Scenario  A 
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2.  Sensitivity  Analysis  of  Measure  of  Performance  to  Variations 
of  Ki  for  Scenario  B:  Target  is  Moving  with  a  Nominal  Speed 
(8m/s)  with  a  Constant  Heading 

The  sensitivity  analysis  of  the  measure  of  performance,  Mi  to  variations  of 
parameter  Ki  is  examined  in  a  scenario  where  the  target  is  moving  with  constant 
heading  and  the  commanded  range  is  300m.  This  scenario  investigates  the 
effects  of  constant  target  heading  on  the  errors  77,  p*,  a  and  Mi.  The  initial 
conditions  are:  (1)  SUAV  velocity  =  28  m/s;  (2)  target  velocity  =  8m/s;  (3)  initial 
position  of  the  SUAV  is  at  [0,  -1000,  300];  (4)  initial  position  of  the  target  is  at  [0, 
0,  0]  and  (5)  K2  =  0.20. 

The  same  nominal  value  of  8m/s  is  chosen  to  investigate  the  effect  of 
constant  target  heading.  Figure  14  shows  the  variation  of  r\,  p*,  s  and  Mi  with 
variations  in  Ki  for  Scenario  B  while  Figure  15  shows  the  error  dynamics  for  the 
optimal  case  of  Ki  =  0.550  for  Scenario  B. 

The  following  observations  can  be  made  from  the  plots: 

(a)  From  Figure  14,  It  is  observed  that  the  relative  range  holding  error, 
p*  increases  with  increasing  Ki.  This  is  accompanied  by  a  corresponding 
decrease  in  the  r|  and  s  errors,  resulting  in  an  overall  decrease  of  Mi . 

(b)  From  Figure  15,  it  follows  that  the  increasing  of  Ki  extends  the 
settling  time. 
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Scenario  B:  Moving  Target  with  Constant  Target  Heading 


Measure  of  Performance,  Mi  with  Variations  in  Ki 


Performance  of  r|,  p*,  s  and  Mi  with  Variations  in  Ki 
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Figure  14.  Variation  of  Mi  vs  Ki  for  Scenario  B 
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Scenario  B:  Ki  =  0.550  (Optimal  Case) 


SUAV  target  VBTT  control  law  tracking  history 


Plot  of  UAV  and  Target  Track 
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Pan  /  Tilt  angles  convergence  history  and  gimbal  camera  angle  errors 
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Figure  15.  Sensitivity  Analysis  for  Ki  =  0.550  for  Scenario  B 
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3.  Sensitivity  Analysis  of  Measure  of  Performance  to  Variations 
of  Ki  for  Scenario  C:  Target  is  Moving  with  a  Nominal  Speed 
(8m/s)  with  Variable  Heading 

The  sensitivity  analysis  of  the  measure  of  performance,  Mi  to  variations  of 
parameter  Ki  is  examined  in  a  scenario  where  the  target  is  moving  with  varying 
target  heading  and  the  commanded  range  is  300m.  This  scenario  investigates 
the  effect  of  variable  target  heading  on  the  errors  r|,  p*,  s  and  Mi.  The  initial 
conditions  are:  (1)  SUAV  velocity  =  28  m/s;  (2)  target  velocity  =  8m/s;  (3)  initial 
position  of  the  SUAV  is  at  [0,  -1000,  300];  (4)  initial  position  of  the  target  is  at  [0, 
0,  0]  and  (5)  K2  =  0.20. 

Previous  results  obtained  [5]  indicated  that  the  SUAV’s  range  holding 
capability  decreases  as  the  target  speed  increases  from  5m/s  to  15m/s. 
Therefore,  a  nominal  value  of  8m/s  is  chosen  to  investigate  the  effect  of  varying 
target  heading.  Figure  16  shows  the  variation  of  r|,  p*,  s  and  Mi  with  variations  in 
Ki  for  Scenario  C  while  Figure  17  shows  the  error  dynamics  for  the  optimal  case 
of  Ki  =  0.550. 

The  following  observations  can  be  made  from  the  plots: 

(a)  From  Figure  16,  it  is  observed  that  the  relative  range  holding  error, 
p*  increases  with  increasing  Ki.  This  is  accompanied  by  a  corresponding 
decrease  in  the  r|  and  s  errors,  resulting  in  an  overall  decrease  of  Mi . 

(b)  From  Figure  17,  it  follows  that  the  increasing  of  Ki  extends  the 
settling  time. 

(c)  Compared  to  the  stationary  target  scenario,  the  value  of  optimal  Ki 
increases  when  there  is  a  disturbance  to  the  target  motion.  When  the  feedback 
gain  K  increases,  the  control  effort  required  to  compensate  for  errors  usually 
increases  correspondingly. 
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Scenario  C:  Moving  Target  with  Variable  Target  Heading 


Measure  of  Performance,  Mi  with  Variations  in  Ki 


Performance  of  r|,  p*,  s  and  Mi  with  Variations  in  Ki 


K1=0.100 


Figure  16.  Variation  of  Mi  vs  Ki  for  Scenario  C 
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Scenario  C:  Ki  =  0.550  (Optimal  Case) 


SUAV  target  VBTT  control  law  tracking  history 
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Range  convergence  history  of  the  SUAV  to  the  desired  range  of  300m 


Plot  of  UAV  Target  Range  Tracking  Performance 


34 


Pan  /  Tilt  angles  convergence  history  and  gimbal  camera  angle  errors 
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Figure  17.  Sensitivity  Analysis  for  Ki  =  0.550  for  Scenario  B 
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4.  Summary  of  Simulation  Results 


a.  Variations  of  Mi  for  Scenarios  A,  B,  C 

Figure  18  summarizes  the  trend  of  Mi  with  variations  in  Ki  for  the 
three  target  maneuver  scenarios.  It  is  observed  that  for  all  values  of  Ki,  the 
range  of  values  for  Mi  is  minimal  in  a  stationary  target  scenario  while  the  Mi 
values  in  a  variable  target  heading  scenario  (Scenario  C)  are  the  largest. 
Moreover,  the  variation  of  the  target  heading  has  a  more  adverse  impact  on  the 
Mi  values  compared  to  the  target  speed.  It  is  also  observed  that  Mi  is  minimal  at 
a  value  of  KI  =  0.50  for  Scenario  A  while  Mi  is  minimal  at  a  value  of  Ki  =  0.550 
for  Scenario  B  and  C.  Finally,  it  is  noted  that  the  region  of  optimal  Ki  is  bounded 
with  small  variations  of  feasible  Ki.  This  allows  the  optimal  value  for  all  three 
scenarios  to  be  quickly  found  by  further  analysis  within  the  bounded  feasible 
region  of  Ki. 


Summary  of  Measure  of  Performance,  Mi  with  Variations  in  Ki 


Figure  18.  Plot  of  Mi  vs  Ki  for  Scenarios  A,  B,  C 
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b.  Variations  of  M1  for  Scenario  A1:  Target  is  Stationary 
with  Different  Values  of  Time  Delay 

Figure  19  illustrates  the  impact  on  Mi  with  the  introduction  of  a  time 
delay  to  the  system.  It  is  observed  that  as  the  value  of  the  time  delay  increases,  it 
significantly  limits  the  feasible  values  of  Ki.  As  the  value  of  time  delay  increases, 
Mi  increases  exponentially  (loss  of  optimality). 

For  each  plot,  the  departure  point  where  there  is  a  significant 
change  in  the  slope  (denoted  by  a  black  circle)  is  analyzed.  It  can  be  observed 
that  the  black  circles  and  hence  the  value  of  Mi  increases  as  the  time  value  is 
increases.  In  conclusion,  the  introduction  of  time  delay  requires  a  significant 
decrease  of  Ki.  This  results  in  a  significant  loss  of  optimality,  increasing  the 
overall  error. 


Summary  of  Measure  of  Performance,  Mi  with  Variations  in  Ki 


Ki 


Figure  19.  Plot  of  Mi  vs  Ki  for  Scenario  A1 . 
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c.  Variations  of  Mi  for  Scenario  Cl:  Target  is  Moving  with  a 
Nominal  Speed  (8m/s)  with  Variable  Heading  with 
Different  Values  of  Time  Delay 

Figure  20  illustrates  the  impact  on  Mi  with  the  introduction  of  a  time 
delay  to  the  system.  It  is  observed  that  as  the  value  of  the  time  delay  increases,  it 
limits  the  feasible  values  of  K-|.  As  the  value  of  time  delay  increases,  Mi 
increases  exponentially  (loss  of  optimality)  with  increasing  values  of  Ki. 

For  each  plot,  the  departure  point  where  there  is  a  significant 
change  in  the  slope  (denoted  by  a  black  circle)  is  analyzed.  It  can  be  observed 
that  the  black  circles  and  hence  the  value  of  Mi  increases  as  the  time  delay  is 
increases.  In  conclusion,  the  introduction  of  time  delay  requires  a  significant 
decrease  of  Ki.  This  results  in  a  significant  increase  in  the  overall  error. 


Summary  of  Measure  of  Performance,  Mi  with  Variations  in  Ki 


Ki 
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Figure  20.  Plot  of  Mi  vs  Ki  for  Scenario  Cl 


C.  CONCLUSIONS  ON  SIMULATION  RESULTS 

The  SIMULINK  based  results  obtained  in  the  preceding  section  investigate 
the  various  target  maneuver  scenarios  and  the  effect  of  the  measure  of 
performance  Mi,  with  variation  in  the  feedback  gain,  Ki.  These  results  showed 
that  there  is  no  single  value  of  Ki  that  is  able  to  satisfy  all  scenarios.  This  implies 
that  the  existing  control  law  is  not  robust  enough  to  meet  different  operational 
scenarios  and  therefore  it  is  necessary  to  develop  an  improved  control  law.  A 
new  adaptive  vision  based  guidance  law  is  recommended  for  this  purpose. 

D.  DISCUSSION  OF  NEW  ADAPTIVE  VISION  BASED  GUIDANCE  LAW 

The  new  adaptive  vision  based  guidance  law  [6]  derives  the  estimates  of 
the  target’s  velocity  by  using  a  fast  estimation  algorithm  with  analytically  proven 
performance  bounds.  A  review  of  the  target  motion  estimation  developments  is 
presented  below. 

Let  p(t)  =  [px(t),py(t),pz(t)]T  be  the  position  of  the  target  with  respect  to  the 

UAV  in  the  inertial  frame  and  let  h(t)  denote  the  relative  altitude  of  the  UAV 
above  the  target.  Let  VUAV(t)  be  the  UAV’s  speed  and  let  Vg(t)  be  the  projection  of 

VUAV(t)onto  the  horizontal  plane.  Denoting  the  UAV  flight  path  angle  byy(t), 
Vg(t)  =  VUAV(t)cosy(t).  Let  V,(t)and  ijjt(t)  be  the  amplitude  and  the  orientation  of 
the  target’s  velocity  in  the  horizontal  plane  and  Vh(t)  be  the  rate  of  change  of 
target  elevation.  Let  r|(t)  denote  the  angle  between  the  UAV’s  velocity  vector  and 
the  vector  perpendicular  to  the  light  of  sight  (LOS).  The  kinematic  equations  for  a 
UAV  tracking  a  target  are: 
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P(0)  =  P0, 


pit)  =  -V  it) sin  7(0  +  Vt  it)  sin {yf  (t)  -  (y(t)  -  7(0)), 
=  0,  ico(t))sm(v(t)  +  /?,  (Mt))), 


V  it)  cos  7(0  -  Vt  it)  cos[^,  (0  -  Wit)  -  7(0)] 

7(0  =  - — - 

Pit) 


+  Yit ) 


7(0)  =  7o> 


Vg{t)smy(t) 

TO  sin  ^,(0 

Pit)  =  - 

Vgit)  cosy  {t) 

+ 

Vt(t)  cos  yt(t) 

VUAvit)smyit)_ 

m  _ 

(27) 


where 


A(®(0)  =  sign(ps  it))^p;  (0  +  p]  it) , 

O,  (0  =  (0  +  0  (0  cos(^(  (0  -  K0)> 

o  (0  =  V®i2(0  +  ®22(0,  ¥,  it)  =  tan-1 


/?2(<y(0)  =  tan  1 


APC(0A 


vA(0y 
Pc  (0  =  0  (0  sin(^,  (0  -  iK0)> 


A^(0A 


V®2(0y 


It  is  worth  mentioning  that  in  Equation  (27),  both  the  velocity  of  the  UAV 
and  the  target  are  explicitly  considered. 

The  relative  position  p(t)  can  be  calculated  as: 


P(t)  = 


P,it ) 

Py(t) 

PW) 


cRpdt)  = 


hit) 


-u(t)  sin  0(t)  +  v  sin  <p(t)  cos  6{t)  +  cos  (pit)  cos  0(t) 


u{t) 

v(0 

1 


where 


w(0&v(0  =  coordinates  of  target  center  in  the  camera  frame. 

c7i?  =  coordinate  transformation  from  the  camera  frame  to  the  inertial 
frame. 

cp{t)  &  0{t)  =  UAV's  known  roll  and  pitch  Euler  angles  for  the  rotation  matrix 
C R ■ 
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The  control  objective  is  to  regulate  pit) to  pd  where  pd  is  a  given  desired 

2D  horizontal  range  between  the  UAV  and  the  target.  Furthermore,  the  relative 
altitude  h(t)  is  not  considered  and  Equation  (27)  reduces  to 


Pjt) 

PyiO 


-rg(0 


sin^-(r) 

COS^(t) 


+  K(0 


sin  V,(t) 
cos  y/t  {t) 


Let 


coit)  =  Vtit) 


sin^((0 

cos  y/t  it) 


co{  0)  =  <x>0 


The  estimates  of  target’s  velocity  Vt(t) and  heading  angle  ^;(r)can  be 
obtained  through  the  following  steps: 

•  State  Predictor: 


xit)  =  Amxit)-Vgit) 


sin^-(r) 

cos^(r) 


+  d>it), 


xit)  =  x{t)-xit). 


m = xo , 


•  Adaptive  Law: 

<x>it)  =  f  Pr  oji<x>it)  -  Pxit)),  cbiO)  =  d)0 


•  Low-Pass  Filter:  Let 

coris)  =  Cis)a>is),  coriO)  =  cb0, 
a>eis)  =  Cis)d)is),  a>eiO)  =  G)0, 

•  Extraction  of  Vtit) and  ^(r)from  coe(t) 


Vt(t)  =  ^oj2ei  it)  +  oj2elit). 


\J/t  it)  =  tan 


y(Oe2it)d 


More  details  on  the  developments  of  performance  bounds,  theorems  and 
region  of  attraction  can  be  found  in  [6],  The  SUAV  SIMULINK  model  used  in  this 
new  adaptive  guidance  law  is  shown  in  Figure  21.  The  SUAV  lateral  dynamics 
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model  used  in  this  new  guidance  law  is  simple  (with  a  single  integrator  function  of 
the  yaw  rate  command)  and  does  not  account  for  real  UAV  dynamics  and 
processing  delays. 


The  6-DOF  SUAV  model  used  in  the  current  study  accounts  for 
environmental  conditions  and  the  6-DOF  dynamics  of  the  SUAV.  Dynamics  of  the 
6-DOF  SUAV  model  is  non-linear  and  its  precise  numerical  simulation  is  time 
consuming.  Hence  linearization  of  this  model  has  been  performed  before 
integrating  with  the  new  adaptive  control  law.  Linearization  is  performed  using 
the  MATLAB  linear  analysis  tool  in  an  open  loop  system  at  the  following  nominal 
conditions  (^=0,  0=0).  The  SUAV  yaw  rate  \j/  is  the  input  point  and  y/  is  the 
output  point  resulting  from  the  linearization  y/-  f(^).  The  entire  loop  6-DOF 
SUAV  model  with  an  AP  in  feedback  is  illustrated  in  Figure  22. 
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Figure  22.  6-DOF  SUAV  Model 


The  linearization  results  in  a  10th  order  transfer  function  as  shown: 

-1.421e-013  sA10  -  2.183e-011  sA9  -  1.397e-009  sA8  +11.63  sA7  +  1445  sA6  +  5.74e004  sA5  +  7.139e005  sA4  + 
9.999e004  sA3  -  3.497e006  sA2  +  8.513e004  s  +  5.282e006 

- SA1  1 

+  215.8  sA10  +  1.825e004  sA9  +  7.552e005  sA8  +  1.556e007  sA7  +  1.484e008  sA6  +  7.174e008  sA5  +  2.147e009  sA4  + 

3.852e009  sA3  +  3.205e009  sA2  +  5.471  e008  s 

Reduction  of  the  high  order  transfer  function  is  beneficial  as  it  eliminates  the 
unobservable  states  and  simplifies  numerical  calculation.  This  is  done  by  using 
the  minreal  function  in  MATLAB.  The  resulting  reduced  order  (7th  order)  transfer 
function  is  as  follows: 

7.105e-014  sA7  -  7.294e-010  sA6  -  5.988e-009  sA5  +11.63  sA4  +  259  sA3  -  422.1  sA2  -  553.4  s  +  1056 

- SA8  + 

1 1 3.8  sA7  +  3939  sA6  +  4. 1  e004  sA5  +  1 ,724e005  sA4  +  4.54e005  sA3  +  5.82e005  sA2  +  1 ,094e005  s  -  3.024e-01 1 

A  step  response  is  used  to  compare  the  original  linearized  model  and  the 
reduced  order  model  as  illustrated  in  Figure  23.  It  is  observed  that  the  two 
models  are  fairly  similar  in  response  to  a  step  command  and  thus  it  can  be 
concluded  that  the  reduced  order  model  can  also  be  used  to  represent  the 
linearized  6-DOF  SUAV  model.  From  the  plots,  it  is  observed  that  the  reduced 
order  linearized  model  can  be  even  further  simplified  while  preserving  the 
inherent  dynamics.  This  simplified  transfer  function  comprising  of  a  time  delay,  T, 
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(in  the  form  of  e  Ts)  [7]  and  an  integrator 


vSy 


function  is  plotted  for  comparison 


and  is  observed  to  have  a  similar  step  response  to  the  reduced  order  model.  K  is 
the  gain  of  the  integrator  and  determines  the  slope  of  the  step  response.  From 
Figure  22,  the  time  delay  x  is  estimated  to  be  about  1  sec  and  forms  the  upper 
bound  for  the  time  delay. 


Step  Response  to  Linerized  Models 


Figure  23.  Step  Response  Comparison  between  Linearized  Models 


This  time  delay  and  integrator  function  is  implemented  into  the  new 
adaptive  guidance  SIMULINK  model  as  shown  in  Figure  24. 
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rho,  psi,  Vg,  u,  v 

- ►]  pi/2  +  u(3)  -  u(1) 

LOS 

- u(2)  /  sqrt(u(5)A2+u(6)A2) 

height  _h 


LOS,  height,  psi,  Vg,  u, ' 

- KD 


Figure  24.  Implementation  of  Linearized  6-DOF  SUAV  Model 


The  simplified  linearized  model  comprising  of  a  time  delay,  T  and  an 


integrator 


m 

Uv 


function  is  subsequently  tested  for  its  “correctness”  by  comparing 


the  SUAV  tracking  results  for  different  values  of  time  delay  as  seen  in  Figure  25 
-  28.  From  the  plots,  it  is  observed  that  the  as  the  time  delay  increases,  the  error 
in  target  speed  and  heading  increases.  Hence,  the  time  delay  model  is  only  able 
to  track  the  target  effectively  up  to  a  limit  of  0.5  sec  time  delay. 
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Time  Delay,  i  =  0 


2D  Trajectories 
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Plot  of  Target  Speed  and  Error 
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Plot  of  Target  Heading  and  Error 
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Figure  25.  Effect  on  Target  Tracking  with  Time  Delay  =  0 
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Time  Delay,  x  =  0.125s 
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Plot  of  Target  Speed  and  Error 
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Plot  of  Target  Heading  and  Error 
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Figure  26.  Effect  on  Target  Tracking  with  Time  Delay  =  0.125s 
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Time  Delay,  t  =  0.25s 


2D  Trajectories 


Plot  of  Target  Speed  and  Error 


Plot  of  Target  Heading  and  Error 


Figure  27.  Effect  on  Target  Tracking  with  Time  Delay  =  0.25s 
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Time  Delay,  t  =  0.50s 
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Figure  28.  Effect  on  Target  Tracking  with  Time  Delay  =  0.50s 
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IV.  HARDWARE-IN-THE-LOOP  SIMULATION 


A  cornerstone  of  the  development  environment  is  a  hardware-in-the-loop 
(HIL)  simulator.  After  testing  the  target  escape  scenarios  in  SIMULINK 
development  environment,  the  next  logical  step  is  to  implement  the  control  law  in 
the  hardware-in-the-loop  simulation  before  the  actual  flight  test. 

The  simulator  allows  the  aircraft  control  laws  and  mission  functionality  to 
be  tested  without  risking  the  hardware  in  flight  test.  It  also  provides  an  ideal 
training  tool  that  can  be  used  in  the  lab.  Although  HIL  simulation  cannot  replace 
flight  testing,  it  measurably  reduces  the  likelihood  of  failure  by  detecting  bugs  and 
deficiencies  before  the  hardware  is  put  at  risk.  The  schematic  of  the  hardware-in- 
the-loop  setup  is  shown  in  Figure  29.  The  different  components  of  the  hardware 
setup  are  described  in  this  section. 
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MATLAB  RTW  Piccolo  Operator 
Application  Interface  Application 


Figure  29.  Schematic  of  Hardware-in-the-Loop  Setup 
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A.  PC/104  DESCRIPTION  AND  SETUP 

The  PC/104  system  is  a  popular  standardized  form-factor  platform  for 
small  computing  modules.  They  are  typically  used  in  industrial  control  systems  or 
vehicles  with  embedded  control  applications.  As  shown  in  Figure  30,  it  comprised 
of  ultra-compact  (3.6"  x  3.8")  stackable  modules.  Each  stack  must  contain  at 
least  one  motherboard  (CPU),  which  acts  as  a  controller  for  the  peripheral 
components.  The  motherboard  is  often  referred  to  as  a  single  board  computer 
(SBC),  for  it  often  has  interfaces  for  all  standard  PC  components  (e.g.,  keyboard, 
mouse,  serial  ports,  ethernet  port  etc.).  It  should  be  noted  that  the  components 
heat  up  quickly  and  adequate  cooling  means  should  be  provided  to  prevent 
overheating. 


Figure  30.  PC/104  System 


The  PC/104  [8]  is  the  “brain”  of  the  hardware  setup.  It  executes  the  xPC 
target  model  uploaded  from  the  Host  PC.  MATLAB  /  Real  Time  Workshop  must 
be  correctly  configured  according  to  the  step-by-step  instructions  detailed  in  [9] 
before  compiling/building  the  xPC  target  model  in  PC/104.  The  xPC  target  model 
is  uploaded  from  the  Host  PC  to  PC/104  via  a  TCP/IP  network.  The 
communication  link  between  the  PC/104  and  the  Piccolo  AP  controller  is  through 
a  RS232-CAN  bus  cable  for  data  exchange.  For  further  data  analysis  and  real¬ 
time  graph  plotting,  the  xPC  target  model  outputs  can  be  similarly  extracted  via 
UDP/IP  at  near  real-time  to  another  SIMULINK  data  logging  model. 
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B.  PAN-TILT  UNIT  DESCRIPTION  AND  SETUP 


The  PTU-D300  Pan-Tilt  Unit  as  seen  in  Figure  31  from  Directed 
Perception  [10]  provides  fast,  accurate,  and  durable  positioning  of  cameras, 
antennas,  lasers,  and  other  large  payloads  of  up  to  70  lbs.  The  built-in  command 
set  offers  both  ASCII  and  binary  formats.  This  command  set  supports  real-time 
control  at  up  to  60  commands  per  second  with  very  low  and  predictable 
latencies. 


Figure  31 .  PTU-D300  from  Directed  Perceptions 

In  the  hardware  setup,  the  PTU-D300  models  the  motion  of  the  UAV.  This 
is  achieved  by  converting  the  Euler  angles  (roll,  pitch  and  yaw)  obtained  from 
Piccolo  autopilot  into  azimuth  and  elevation  via  a  series  of  coordinate  frame 
transformation.  The  PTU-D300  can  be  connected  to  a  host  computer  via  the 
“Hyper  Terminal”  user  interface  available  in  Microsoft®  Windows  operating 
system  for  the  purposes  of  parameter  configuration.  In  addition,  the  unit  can  also 
be  connected  to  the  PC/104  system  using  a  standard  RS-232  serial  cable  during 
simulation  runs.  It  is  essential  to  consider  the  mechanical  pan-tilt  limits  and 
speeds  of  the  device  and  ensure  that  they  are  not  exceeded  during  simulation 
runs  to  prevent  saturation  of  the  output  signal.  In  addition,  the  operating  speeds 
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in  the  pan-tilt  direction  should  also  be  correctly  configured  to  ensure  desired 
tracking  response.  The  limits  of  the  device  are  detailed  in  Table  1 . 


Resolution 

Sec  Arc/Position 

Deg/Position 

92.5714 

0.025714278 

Position  Properties 

Positions 

Degrees 

Minimum  Pan  Position 

-6803 

-174.93 

Maximum  Pan  Position 

6804 

174.96 

Minimum  Tilt  Position 

-3516 

-90.41 

Maximum  Tilt  Position 

1169 

30.06 

Speed  Properties 

Positions/Sec 

Degrees/Sec 

Minimum  Pan  Position 

1985 

51.04 

Maximum  Pan  Position 

0 

0.00 

Minimum  Tilt  Position 

1985 

51.04 

Maximum  Tilt  Position 

0 

0.00 

Acceleration  Properties 

Positions/Sec2 

Degrees/Sec2 

Minimum  Pan  Position 

2000 

51.43 

Maximum  Pan  Position 

2000 

51.43 

Table  1 .  Operating  Limits  of  the  PTU-D300 


DAQ 


Figure  32.  xPC  Driver  Model  for  the  PTU-D300 
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Figure  32  shows  the  xPC  target  model  that  drives  the  PTU-D300.  The 
model  first  obtains  the  three  Euler  angles  measured  by  Piccolo  AP.  Through  a 
series  of  frame  rotation  and  transformation,  these  three  Euler  angles  are 
subsequently  converted  into  azimuth  (pan)  and  elevation  (tilt)  commands  which 
drives  the  motion  of  the  PTU. 

C.  PICCOLO  PLUS  AUTOPILOT  OVERVIEW  AND  SETUP 

FAMILIARIZATION 

Piccolo  Autopilot  is  a  complete  integrated  avionics  system  from  Cloud  Cap 
Technology  for  small  unmanned  aircraft.  There  are  four  versions  of  Piccolo 
available  in  the  market  and  the  one  used  in  the  hardware  in  the  loop  setup  is  a 
Piccolo  Plus.  The  Piccolo  control  system  consists  of  four  main  parts:  an  avionics 
control  system  (mounted  onboard  the  SUAV  during  flight  tests),  a  ground  station, 
a  computer  for  the  operator  interface  application  and  mission  monitor,  and  a  pilot 
manual  control  interface  via  a  modified  Futaba  radio  controller. 

The  Piccolo  system  employs  two  separate  control  loops:  the  faster  inner 
loop  controls  the  aircraft  dynamics  within  the  aircraft  itself  and  the  slower  outer 
loop  controls  the  path  that  the  aircraft  is  expected  to  follow  via  a  wireless 
communication  link  between  the  piccolo  autopilot  controller  and  the  ground 
control  station.  The  control  law  that  has  been  developed  will  be  utilizing  the  inner 
control  loop  to  realize  the  flight  control  of  the  SUAV.  Typical  Piccolo  HIL 
equipment  and  its  setup  are  shown  as  follow  in  Figure  33.  [1 1],  [12]. 
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Figure  33.  Ground  Station  Setup  (without  Operator  Interface  PC),  SIM  PC  and 

Avionics  Side  of  HIL  Simulation 


1.  Avionics  -  Piccolo  Autopilot  (AP)  Controller 

The  CPU  of  Piccolo  AP  is  the  MPC555  microcontroller,  which  is  a  new 
breed  of  automotive  controller  based  on  the  PowerPC  architecture,  capable  of 
delivering  40  MHz  PowerPC  operation,  including  hardware  floating  point. 

Integrated  within  the  avionic  controller  unit  are  three  ADXRS300  gyros 
and  two  two-axis  ADXL210e  accelerometers.  The  Motorola  Ml 2  GPS  provides 
Piccolo  with  its  basic  groundspeed  and  position.  Included  with  the  Piccolo 
interface  are  a  dual  ported  mpxv50045  4kPa  dynamic  pressure  sensor,  an 
absolute  ported  mpx4115a  barometric  pressure  sensor,  and  a  board  temperature 
sensor.  A  sophisticated  data  link  that  is  built  on  the  MHX  910/2400  radio  modem 
from  Microhard  Systems  Inc.  provides  up  to  40Kbaud  of  throughput  and  is  used 
for  command  and  control,  autopilot  telemetry,  payload  data  transfer  functions  and 
differential  GPS  corrections.  The  frontal  panel  included  the  filtered  44-pin  vehicle 
interface  connector,  GPS  and  UHF  antenna  SMA  connectors  as  well  as  the  Pitot 
and  Static  pressure  port  nipples.  The  Piccolo  block  diagram  and  front  panel 
schematic  is  shown  in  Figure  34. 
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Figure  34.  Piccolo  Block  Diagram  and  Front  Panel 


In  the  HIL  setup  and  simulation  environment,  the  Piccolo  AP  is  connected 
to  Computer  #2  which  runs  the  flight  dynamics  Simulator  software.  The  inter-link 
between  Computer  #2  and  the  Piccolo  AP  controller  is  via  a  USB-CAN  (computer 
area  network)  data  exchange  cable  through  the  CAN  port.  In  addition,  Piccolo  AP 
is  linked  to  PC/104  via  a  RS232  serial  cable  through  the  program  port.  Data 
exchange  is  done  via  COM1 ,  running  at  baud  rate  57,600. 

The  Simulator  allows  the  aircraft  control  laws  and  mission  functionality  to 
be  tested  before  the  actual  flight  testing.  It  reduces  the  likelihood  of  failure  by 
detecting  bugs  and  deficiencies  before  the  aircraft  and  related  hardware  are  put 
at  risk. 

After  launching  the  Simulator  program,  the  program  is  initialized  in  two 
simple  steps.  First,  under  the  FILE  menu  options,  a  default  “cub  aircraft”  model 
file  is  selected  as  its  flight  characteristics  resemble  that  of  the  actual  Tele-Master 
SUAV  that  is  in  used  for  flight  testing.  Secondly,  the  start  state  of  the  Simulator 
also  has  to  be  initialized.  A  default  file  containing  the  geodetic  data  around  the 
Camp  Robert  Airfield  test  site  is  available  in  the  system  for  quick  initialization. 
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The  key  parameters  of  interest  are  the  flying  altitude  of  300m  and  a  flying  speed 
(TAS)  of  28m/s.  The  “Reset”  “Apply  slew”  and  “clear  slew”  radio  button  apply  the 
typed  customized  parameters  to  the  Simulator  program.  The  Simulator  program 
is  started  and  stopped  using  the  “Start”  and  “Stop”  radio  button.  Turbulence 
parameters  can  be  input  to  the  program  to  simulate  weather  and  wind  conditions. 
The  Simulator  program  interface  layout  is  shown  in  Figure  35. 


Figure  35.  Simulator  Program  Interface 


2.  Piccolo  Ground  Station 


Piccolo’s  ground  control  station  is  based  upon  the  same  hardware  that 
makes  up  the  avionics  package.  It  manages  the  communication  link  to  one  or 
more  avionics  systems,  interfaces  to  the  pilot  in  the  loop  console,  and  provides  a 
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command  and  control  stream  to  the  operator  interface  PC.  The  Ground  Station 
connects  to  the  operator  interface  PC  through  a  standard  9-pin  serial  cable.  The 
ground  station  GPS  Antenna  is  connected  to  the  rear  panel  SMB  connector  and 
the  ground  station  UHF  antenna  is  hooked  up  to  the  BNC  connector.  A  6-pin 
circular  DIN  pilot  console  cable  connects  the  pilot  in  the  loop  command  to  the 
Ground  Station  through  a  modified  Futaba  radio  controller.  The  Ground  Station 
exchanges  data  with  the  Piccolo  avionics  via  a  built-in  900  MHz  or  2.4  GHz  ISM 
band  radio  wireless  link  made  from  the  MHX-91 0/2400  frequency  hopping  radio 
from  Microhard  Systems  Inc.  Piccolo  Ground  Station  is  shown  in  Figure  36. 


Figure  36.  Piccolo  Ground  Station  Front  and  Back  Panels 


The  operator  interface  (Ol)  is  a  software  system  that  runs  on  a  Windows 
PC  and  most  of  the  system  features  are  accessible  from  this  interface.  It  provides 
a  command  and  control  interface  for  Piccolo  operators.  The  operator  interface 
communicates  to  the  Ground  Station  over  a  RS-232  serial  link  (default  to  COM1). 
Installation  of  the  Ol  is  through  a  Windows  installer  file,  “Operator  Interface.msi” 
which  is  downloadable  from  the  Cloud  Cap  Technology  site.  The  Ol  is  installed  in 
Computer  #1 . 

The  Ol  provides  two  station  screens  for  operator  interface  with  the  Ground 
Station.  The  Ground  Station  screen  provides  a  Window  Menu  and  Unit  Menu  for 
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user  to  manage  the  avionic  window  display  layout  and  units  of  telemetry  to  be 
displayed.  The  ID  number  of  the  Piccolo  AP  will  have  to  be  added  under  the 
“Network  Control”  interface.  In  addition,  the  power  ratings  under  the  “UHF  Radio 
Settings”  interface  have  to  be  adjusted  to  about  0.001  W  to  minimize  radiation 
during  laboratory  testing.  An  advance  option  under  the  Window  Menu  displayed 
more  advanced  version  of  the  avionics  window  for  operator  interface.  The 
avionics  window  displayed  the  telemetry  data  received  from  Piccolo  avionics.  A 
screenshot  of  the  Piccolo  01  is  displayed  in  Figure  37. 


Figure  37.  Screenshot  of  Piccolo  Operator  Interface 


The  essential  telemetry  information  is  displayed  in  tabulated  pages  which 
are  user  selectable.  The  tabulated  pages  are  arranged  in  the  following  order:  (1) 
Telemetry,  (2)  Commands,  (3)  Map,  (4)  Preflight,  (5)  Limits,  (6)  Sensors,  (7) 
Surfaces,  (8)  Gains,  (9)  Payload  and  (10)  Parameters.  Some  essential  pages 
that  are  required  in  HIL  setup  will  be  briefly  described  in  subsequent  paragraphs. 
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a.  Telemetry  Page 

The  telemetry  page  displays  data  from  all  the  sensors  of  the  system. 
Sensor  information  that  are  displayed  includes  GPS  data,  Air  Data,  Sonic  altimeter, 
MHX  radio  settings,  System  Version,  Diagnostic,  Wind,  Attitude,  Gyro,  RPM  and 
Compass.  The  request  fast  and  request  slow  buttons  alter  the  rate  at  which  the 
telemetry  data  are  sent.  Default  slow  mode  sends  data  once  per  second;  fast  mode 
sends  data  20  times  a  second  or  limited  by  available  bandwidth. 

b.  AP  Commands 

The  autopilot  commands  page  displays  the  current  autopilot  command 
status,  and  allows  the  user  to  change  IAS,  altitude,  turn  rate,  flaps  and  waypoint 
tracker  via  an  interactive  input  interface.  Other  commands  like  autopilot  mode,  stick 
mode,  engine  control  and  flight  actions  are  selectable  through  on-screen  radio 
buttons. 

c.  MAP 

The  map  page  displays  the  current  location  of  the  vehicle,  and 
provides  an  interface  for  creating  flight  plans.  The  map  is  built  on  ESRI’s 
MapObjects,  which  means  that  it  is  capable  of  displaying  geo-referenced  raster  files, 
as  well  as  vector  shape  files.  Customized  map  in  TIF  format  can  be  added  in  using 
the  add  image  layer  or  add  vector  layer  command. 

d.  AP  Limits 

The  limits  page  is  used  to  view  and  alter  the  autopilot  and  mission 
limits.  Autopilot  limits  include  min/max  of  airspeed,  altitude,  bank  angle,  aileron, 
elevator,  rudder,  throttle  and  flap  and  can  be  input  via  interactive  interface.  A  request 
and  send  limit  radio  button  is  used  to  interrogate  and  alter  the  current  limit  on  the 
Piccolo  avionics.  Detailed  procedures  on  setting  of  AP  limits  are  found  at  Cloud  Cap 
Technology  web  site: 

(http://www.cloudcaptech.com/download/Piccolo/Version%201 .3.2/Docs/Piccolo 
% -Page  41, 4.4.3. 1) 
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e.  Sensors 

The  sensors  page  gives  the  current  sensor  readings  and  calibration 
information  for  each  sensor.  It  is  normally  only  used  during  the  setup  process.  An 
important  step  in  the  HIL  setup  is  to  check  and  align  the  Euler  angle  axis  of 
Piccolo  avionics  with  respect  to  the  aircraft  body  frame  out  of  twenty-four 
different  possible  axes  orientation.  A  sample  page  is  shown  in  Figure  38. 


Figure  38.  Alignment  of  Avionics  Orientation  to  Aircraft  Body  Frame 


f.  AP  Gains  and  Trims 

The  gains  page  is  used  to  view  and  alter  the  autopilot  gains  and 
trims.  There  are  gains  for  eight  loops.  Before  the  Piccolo  AP  can  be  gainfully 
utilized  for  HTL  simulation  and  control,  the  gains  of  the  AP  aircraft  model  have  to 
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be  tuned  correctly.  Detailed  procedures  on  tuning  of  AP  gains  and  trims  are 
found  at  Cloud  Cap  Technology  web  site: 

(http://www.cloudcaptech.com/download/Piccolo/Version%201 .3.2/Docs/Piccolo 

%  (Page  41  -  43,  4.4.3.2M.4.3.3) 

3.  Flight  Gear  Visualization  Environment  Familiarization 

During  HIL  simulation,  it  is  necessary  to  be  able  to  visualize  the  effects 
that  the  control  law  have  on  the  flight  performance  and  stability  of  the  aircraft.  An 
open  source  application  called  Flight  Gear  is  provided  for  the  visualization  of 
aircraft  attitude  through  an  UDP/IP  network  protocol.  In  order  to  get  Flight  Gear 
to  accept  the  state  packet  it  must  started  with  the  correct  command  line  switches. 
A  batch  file  “runflightgear.bat”  is  provided  for  this.  The  Flight  Gear  application  is 
installed  on  Computer  #2  equipped  with  a  video  card  designed  for  OpenGL 
hardware  acceleration.  The  flight  visualization  is  activated  from  the  Piccolo 
Simulator  Flight  Gear  output  interface  selection  (Computer  #2).  A  screen  shot 
display  of  the  Flight  Gear  visualization  is  shown  in  Figure  39. 
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4. 


HIL  Network  Communication  and  Data  Exchange 


a.  Router  Network  Communication  Protocol 

TCP/IP  and  UDP/IP  are  the  two  forms  of  network  communication 
protocol  used  in  the  HIL  network  communication  setup.  TCP/IP  is  utilized  for  the 
uploading  of  xPC  Target  model  from  Host  PC  to  PC/104.  UDP/IP  is  utilized  for 
the  downloading  of  xPC  Target  model  outputs  from  PC/104  to  Flight  Gear’s 
computer  for  visualization  of  the  aircraft  attitude  and  performance,  as  well  as 
extraction  of  relevant  xPC  Target  data  to  another  SIMULINK  Data  Extraction 
program  running  on  Host  PC  (Computer  #1).  The  xPC  Target  data  are 
downloaded  for  post  simulation  data  analysis  and  real-time  graph  plotting  utility 
purposes. 

UDP/IP  is  described  as  being  connectionless  and  unreliable,  the 
sending  party  will  send  out  information  whenever  it  can,  and  the  receiver  will 
receive  information  whenever  it  is  able  to  do  so.  Information  that  is  sent  when  the 
receiver  is  not  available  will  simply  be  lost.  UDP/IP  is  widely  employed  as  the 
choice  network  communication  protocol  for  real-time  applications,  since  only  the 
most  recent  information  is  of  relevance. 

b.  Setting  Communication  to  Piccolo  AP  in  HIL 

Serial  Interface  (SI)  communication  technology  is  widely  employed 
in  data  interfacing  in  modern  control  in  establishing  the  link  between  the  ground 
control  unit  and  the  airborne  vehicle.  Mathworks’  xPC  target  provides  an  RS232 
library  that  supports  a  variety  of  serial  instruments.  These  drivers  support 
synchronous,  asynchronous,  and  binary  (asynchronous)  communication  modes 
and  should  be  added  to  the  MATLAB  existing  libraries  before  use  on  the  control 
model.  Although  the  latest  xPC  target  release  supports  RS232/422/485  protocols 
and  a  number  of  serial  communication  boards  including  Quatech  and  Diamond’s 
products,  it  still  does  not  extend  the  reading  capability  of  new  serial  data  formats, 
such  as  proprietary  communication  protocol  in  Piccolo  AP. 
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The  application  of  a  binary  asynchronous  communication  that  is 
supported  directly  by  the  standard  Mathworks  library  relieves  the  user  of  having 
to  develop  an  actual  RS232  hardware  driver.  It  conveniently  allows  focusing  on 
the  implementation  of  data  interfacing  rather  than  the  hardware  programming. 
Since  the  majority  of  SI  formatting  is  proprietary,  the  most  efficient  way  to 
implement  the  SI  capability  consists  in  writing  Level-2  S-functions.  The  technique 
used  in  this  thesis  provides  the  operational  separation  of  principal  functions 
among  the  pre-built  library  blocks  and  the  user-developed  S-functions.  Standard 
serial  communication  blocks  deliver  raw  binary  data  to  the  model  using  the 
optimized  Mathworks  routines.  The  S-functions  perform  format  specific 
processing  that  is  not  readily  available.  Figure  40  depicts  this  concept  [5], 


Simulink  Simulink 

RS-232  Blockset  User  Developed  RS-232  Blockset 


IN  OUT 


Figure  40.  Separation  of  Interface  Functions 

A  customized  SIMULINK  RTW  communication  program  has  been 
developed  for  the  data  exchange  between  xPC  Target  model  and  Piccolo 
avionics  for  use  in  the  control  law  SIMULINK  model  as  shown  in  Figure  41 . 
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Figure  41 .  SIMULINK  RTW  Communication  Interface 


Using  the  customized  SIMULINK  RTW  communication  interface 
program,  relevant  telemetry,  control,  diagnostics  and  AP-states  information  can 
be  readily  extracted  from  Piccolo  avionics  output  for  the  xPC  Target  model 
guidance  control  computation.  The  computed  control  commands  from  xPC 
Target  model  can  be  translated  into  Piccolo  communication  protocol  format  for 
control  of  Piccolo  avionics. 

The  SIMULINK  RTW  communication  interface  program  comprised 
of  MATLAB  standard  RS232  serial  binary  communication  blocks  and  customized 
programmed  Level-2  S-functions.  The  SIMULINK  RTW  communication  interface 
program  applies  color-coded  blocks  and  paths  to  represent  the  WRITE  (GREEN) 
and  READ  (RED)  blocks  and  paths  between  xPC  Target  and  Piccolo  avionics. 
To  ensure  that  the  SIMULINK  RTW  communication  block  is  communicating  to 
the  correct  Piccolo  avionics  unit,  the  appropriate  Piccolo  avionics  unit  ID 
(indicated  on  the  Piccolo  unit)  has  to  be  input  properly  in  the  program. 
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c. 


Reading  from  Piccolo  AP 


The  READ  block  of  the  SIMULINK  RTW  communication  interface 
has  five  customized  S-function  blocks  namely:  “pplus_readstream.c” 
“pplus_autopil.c”  “pplus_diag.c”  “pplus_control.c”  and  “pplus_telemetry.c”  nested 
within.  The  input  parameters  for  S-function  “pplus_readstream.c”  are  Piccolo 
Autopilot  ID  (APID)  and  buffer  size  (BUF).  The  output  from  the  S-function 
comprised  of  “data”  and  “header  type”  are  parsed  through  a  decoder  sub-block. 
The  other  four  S-functions  that  are  nested  within  the  decoder  sub-block  are 
utilized  to  decode  the  proprietary  Piccolo  communication  protocol  to  separate  out 
the  Piccolo  telemetry,  control,  diagnostics  and  AP  states  information.  The  READ 
block  of  the  RTW  communication  interface  program  is  depicted  in  Figure  42. 
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Figure  42.  READ  Block  of  SIMULINK  RTW  Communication  Interface  Program 


d.  Writing  to  Piccolo  AP 

The  WRITE  block  of  the  SIMULINK  RTW  communication  interface 

program  converts  and  codes  the  xPC  VBTT  guidance  control  message  into 

proprietary  Piccolo  communication  protocol  before  sending  it  through  the 

standard  MATLAB  RS232  serial  binary  communication  block. 
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A  MATLAB  sub-block  is  utilized  to  convert  the  xPC  Target  guidance 
commands  into  an  “AP  payload  data  stream”.  The  input  to  the  sub-block  is  the 
AP  control  loop  number,  control  type  and  control  command  values.  The  output 
from  the  sub-block  is  eight  bytes  of  “AP  loop  message”  also  known  as  the 
“Payload”  for  the  Piccolo  AP. 

An  AP  Stream  Wrapper  block  is  utilized  to  code  the  “AP  loop 
message”  or  “Payload”  into  proprietary  Piccolo  communication  binary  data 
stream.  The  proprietary  Piccolo  communication  binary  data  stream  is  coded  as  a 
2-layers  communication  protocol  format.  An  outer  layer  is  utilized  to  differentiate 
the  type  of  data  stream  for  “header”  and  “checksum”  purposes,  and  an  inner 
layer  is  utilized  to  differentiate  the  type  of  command  payload  “packet”  information. 
Three  customized  S-functions,  namely  “toplevelcrc.c”  “enc-apilot_loop_fix.c”  and 
“enc_top_level26.c”  are  nested  within  the  WRITE  block,  to  perform  the  checksum 
and  proprietary  coding  functions.  The  coded  binary  data  stream  is  subsequently 
transmitted  through  MATLAB  standard  RS232  serial  communication  block  to 
Piccolo  AP.  A  typical  WRITE  block  of  the  RTW  communication  interface  program 
is  depicted  in  Figure  43. 
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Figure  43.  WRITE  Block  of  SIMULINK  RTW  Communication  Interface  Program 
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A  summary  of  the  S-functions  and  their  functions  are  tabulated  in 

Table  2. 


Where 

Name  of  S-Functions 

Functions 

READ  Block 

pplus_readstream.c 

Extract  messages  from  the 

Piccolo  RAW  data,  mark 

output  with  a  header 

READ  Block 

pplus_autopil.c 

Parse  Piccolo  AP  states 

READ  Block 

pplus_diag.c 

Parse  Piccolo  diagnostic 

READ  Block 

pplus_control.c 

Parse  Piccolo  Control 

READ  Block 

pplus_telemetry.c 

Parse  Piccolo  Telemetry 

WRITE  Block 

enc_top_level26.c 

Outer  Level  Wrapper 

WRITE  Block 

Toplevelcrc.c 

Header  /  Checksum 

WRITE  Block 

enc-apilot_loop_fix.c 

Inner  Level  Wrapper 

Table  2.  Summary  of  S-Functions 


An  “IN IT -GUI”  M-script  file  is  utilized  to  initialize  all  the  Piccolo  AP 
state  variable  names  and  values  that  are  used  in  the  SIMULINK  RTW 
communication  interface  program.  The  “INIT-GUI”  M-script  file  is  placed  under 
the  “Model  Properties/Model  callbacks”  block  for  initialization. 

A  separate  UDP  communication  SIMULINK  program  utilizing  the 
“Pack,  UDP-Send-Binary”  in  SIMULINK  library  is  used  to  output  the  xPC  Target 
output  data  stream  (from  PC/104)  to  another  SIMULINK  Data  Extraction  program 
running  on  Computer  #1.  The  SIMULINK  Data  Extraction  program  utilizes  the 
“UDP-Receive-Binary,  UnPack”  UDP  communication  block  to  receive  the  data 
stream.  This  arrangement  is  to  alleviate  the  computational  constraints  of  PCI 04 
in  displaying  the  real-time  data  stream.  The  extracted  xPC  Target  data  are 
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utilized  for  post  simulation  data  analysis  and  real-time  graph  plotting  utility  for 
visualization  of  the  simulation  progress  (on  Computer#!). 


D.  HARDWARE-IN-THE-LOOP  (HIL)  SIMULATION  RESULTS 

This  section  describes  implementation  of  the  developed  control  law  in  the 
HIL  environment  together  with  commercial-off-the-shelf  Piccolo  Plus  AP  and 
testing  of  the  control  law  performance  in  the  scenarios  discussed  previously  as 
follows: 

•  Scenario  A:  Stationary  target. 

•  Scenario  A1:  Target  is  stationary  with  different  values  of  time 
delay. 

•  Scenario  C:  Target  is  moving  with  a  nominal  speed  (8m/s)  with 
variable  heading. 

•  Scenario  Cl:  Target  is  moving  with  a  nominal  speed  (8m/s)  with 
varying  heading  and  different  values  of  time  delay. 


It  should  be  noted  that  testing  in  the  HIL  simulation  environment  is  the  last 
testing  stage  before  implementing  any  control  algorithms  in  real  flight.  Due  to  the 
fact  that  the  inner-loop  controller  (autopilot)  of  the  initial  SIMULINK  model  is  now 
implemented  in  hardware,  this  leads  to  a  discrepancy  between  the  software 
modeling  results  and  HIL  results.  The  most  noticeable  difference  is  the  presence 
of  noise  in  the  HIL  simulation  results  and  as  such,  non-consistent  results  might 
have  to  be  filtered  before  further  analysis  and  interpretation. 
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1.  Sensitivity  Analysis  of  Measure  of  Performance  to  Variations 
of  Gain  Ki  for  Scenario  A:  Stationary  Target 

The  sensitivity  analysis  of  the  measure  of  performance,  Mi  to  variations  of 
gain  Ki  is  examined  in  a  scenario  where  the  target  is  stationary  and  the 
commanded  range  is  300m.  The  initial  conditions  are:  (1)  SUAV  velocity  =  28 
m/s;  (2)  target  velocity  =  Om/s;  (3)  initial  position  of  the  SUAV  is  at  [0,  -1000, 
300];  (4)  initial  position  of  the  target  is  at  [0,  0,  0]  and  (5)  K2  =  0.20.  Figure  44 
shows  the  variation  of  r\,  p*,  s  errors  and  Mi  criterion  with  variations  of  gain  Ki 
for  Scenario  A  while  Figure  45  shows  the  error  dynamics  for  the  optimal  case  of 
Ki  =  0.300. 

The  following  observations  can  be  made  from  the  plots: 

(a)  From  Figure  44,  it  is  observed  that  Mi  can  also  be  minimized  at  a 
value  of  Ki  =  0.30.  Compared  to  the  SIMULINK  results,  the  errors  obtained  in  the 
HIL  simulations  are  larger  in  value. 

(b)  From  Figure  45,  exceptionally  high  values  (spikes)  are  observed  in 
the  r|  and  s  error  plots.  These  spikes  occur  several  times  but  with  each 
occurrence  lasting  for  very  short  periods  of  time  (almost  instantaneously)  before 
returning  to  the  normal  range  of  values.  This  is  inherent  for  the  HIL  simulations 
due  to  the  integration  between  software  and  several  hardware  components  and 
should  be  filtered  off  in  actual  flight  test. 
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Scenario  A:  Stationary  Target  (HIL) 


Figure  44.  Variation  of  Mi  vs  Ki  for  Scenario  A  (HIL) 
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Scenario  A:  Ki  =  0.300  (HIL,  Optimal  Case) 


SUAV  target  VBTT  control  law  tracking  history 


Plot  of  UAV  and  Tarket  Track 


East,  Y  (m) 


Range  convergence  history  of  the  SUAV  to  the  desired  range  of  300m 


Plot  of  UAV  Target  Range  Tracking  Performance 
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Figure  45.  Sensitivity  Analysis  for  K-i  =  0.300  for  Scenario  A  (HIL) 


77 


2.  Sensitivity  Analysis  of  Measure  of  Performance  to  Variations 
of  Ki  for  Scenario  C:  Target  is  Moving  with  a  Nominal  Speed 
(8m/s)  with  Variable  Heading 

The  sensitivity  analysis  of  the  measure  of  performance,  Mi  to  variations  of 
parameter  Ki  is  examined  in  a  scenario  where  the  target  is  moving  with  a 
constant  heading  and  the  commanded  range  is  300m.  The  initial  conditions  are: 
(1)  SUAV  velocity  =  28  m/s;  (2)  target  velocity  =  8m/s;  (3)  initial  position  of  the 
SUAV  is  at  [0,  -1000,  300];  (4)  initial  position  of  the  target  is  at  [0,  0,  0]  and  (5)  K2 
=  0.20.  Figure  46  shows  the  variation  of  r|,  p*,  s  errors  and  Mi  criterion  with 
variations  in  Ki  for  Scenario  B  while  Figure  47  shows  the  error  dynamics  for  the 
optimal  case  of  Ki  =  0.70  for  Scenario  C. 

The  following  observation  can  be  made  from  the  plots: 

(a)  From  Figure  46,  it  is  observed  that  value  of  Mi  decreases  with 
larger  values  of  Ki  and  is  minimized  at  a  value  of  Ki  =  0.70. 
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Scenario  C:  Moving  Target  with  Variable  Target  Heading  (HIL) 
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Scenario  C:  =  0.700  (HIL,  Optimal  Case) 


SUAV  target  VBTT  control  law  tracking  history 


Plot  of  UAV  and  Tarket  Track 


Range  convergence  history  of  the  SUAV  to  the  desired  range  of  300m 


Plot  of  UAV  Target  Range  Tracking  Performance 
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Pan  /  Tilt  angles  convergence  history  and  gimbal  camera  angle  errors 
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Plot  of  UAV  Pan  Tilt  Angles  and  Errors 
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Figure  47.  Sensitivity  Analysis  for  Ki  =  0.700  for  Scenario  C  (HIL) 


81 


3.  Summary  of  HIL  Simulation  Results 


a.  Variations  of  Mi  for  Scenarios  A  and  C 

Figure  48  summarizes  the  trends  (indicated  by  the  dotted  lines)  of 
Mi  with  variations  of  K-i  for  the  two  target  maneuver  scenarios  in  a  HIL  simulation 
environment.  This  is  compared  to  the  earlier  results  obtained  from  the  SIMULINK 
numerical  simulations  as  indicated  by  the  solid  lines.  It  is  observed  that  the  HIL 
results  are  in  unison  with  the  SIMULINK  results.  The  key  difference  is  the  larger 
values  of  Mi  criterion  for  the  HIL  results,  indicating  higher  values  of  r|,  p*  and  s 
errors.  This  is  expected  due  to  a  noticeable  level  of  noise  present  in  the  HIL 
simulations. 


Summary  of  Measure  of  Performance,  Mi  with  Variations  in  Ki 


Figure  48.  Plot  of  Mi  vs  for  Scenarios  A  and  C 
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b.  Variations  of  Mi  for  Scenario  A1:  Target  is  Stationary 
with  Different  Values  of  Time  Delay 

Figure  49  illustrates  the  impact  on  Mi  with  time  delay.  As  indicated 
by  the  dotted  lines,  it  is  observed  that  the  introduction  of  a  time  delay  does  not 
adversely  affect  the  values  of  Mi  to  the  same  degree  as  shown  in  SIMULINK- 
based  results.  This  illustrates  that  the  chosen  software-based  environment  and 
results  obtained  are  more  conservative  in  nature;  in  turn  the  HIL  results 
incorporating  a  real  AP  unit  are  more  promising  and  representative  of  real  flight 
implementation. 


Summary  of  Measure  of  Performance,  Mi  with  Variations  in  Ki 


Figure  49.  Plot  of  Mi  vs  Ki  for  Scenario  A1  (HIL) 
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c.  Variations  of  Mi  for  Scenario  Cl:  Target  is  Moving  with  a 
Nominal  Speed  (8m/s)  with  Variable  Heading  with 
Different  Values  of  Time  Delay 

Figure  50  illustrates  the  impact  on  Mi  with  time  delay  to  the  system 
in  a  HIL  simulation  environment.  As  before  the  results  are  less  conservative  and 
therefore  promise  greater  feasibility  of  flight  implementation. 


Summary  of  Measure  of  Performance,  Mi  with  Variations  in  Ki 
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Figure  50.  Plot  of  Mi  vs  Ki  for  Scenario  Cl  (HIL) 
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E.  HIL  SIMULATION  CONCLUSIONS 

Although  the  obtained  HIL  results  are  noisier  in  general  when  compared  to 
software  simulation  results,  the  HIL  simulation  results  still  exhibit  similar 
performance  for  the  stationary  target  (Scenario  A)  and  target  maneuver  case 
(Scenario  C).  The  differences  in  the  HIL  and  SIMULINK  results  are  due  to  the 
inherent  differences  in  the  AP  and  6-DOF  UAV  models  employed  in  the  HIL 
simulation.  The  additional  hardware  noises  that  are  present  in  the  HIL  simulation 
could  also  have  attributed  to  the  variations  in  the  results.  However,  both  the 
SIMULINK  and  HIL  results  have  validated  the  performance  of  the  control  law  for 
these  two  scenarios. 

When  time  delays  were  introduced  in  Scenarios  A1  and  Cl,  the  results 
obtained  between  SIMULINK  simulations  and  HIL  simulations  do  not  exhibit  the 
same  performance  and  trend.  This  observation  indicates  that  testing  in  software 
and  hardware  environments  can  be  vastly  different  for  certain  scenarios.  As 
such,  it  is  essential  to  perform  simulations  in  the  HIL  environment  before  any 
actual  flight  as  HIL  simulations  better  emulate  actual  flight  dynamics  better. 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  CONCLUSIONS 

In  this  thesis,  the  robustness  of  the  existing  Vision  Based  Target  Tracking 
(VBTT)  adaptive  guidance  law  was  further  analyzed  in  software  simulations  by 
considering  scenarios  where  the  target  velocity,  both  magnitude  and  direction, 
were  varied.  Scenarios  with  time  delay  in  feedback  were  also  subsequently 
analyzed.  The  results  indicated  that  there  was  no  single  value  of  the  feedback 
gain  Ki  that  was  able  to  satisfy  all  possible  variations  of  target  maneuver.  This 
implied  that  the  existing  control  law  has  not  been  designed  to  meet  different 
operational  scenarios  and  therefore  it  is  necessary  to  develop  an  improved 
control  law. 

The  results  obtained  in  the  hardware-in-the-loop  (HIL)  simulation 
environment  generally  exhibit  the  same  performance  as  those  obtained  in 
software  simulations  for  the  non-time  delay  target  maneuver  scenarios.  However, 
larger  error  values  were  obtained  due  to  the  presence  of  noise  in  HIL  simulations 
and  differences  of  the  6-DOF  modeling  of  UAV  dynamics.  In  addition,  it  should 
be  noted  that  software  and  HIL  simulation  results  were  different  when  time  delay 
was  introduced.  HIL  results  in  the  time  delay  scenarios  were  less  restrictive  in  the 
values  of  the  feedback  gain  and  therefore  promise  greater  feasibility  in  actual 
flight  implementation. 

B.  RECOMMENDATIONS 

To  complete  the  vision-based  hardware-in-the-loop  simulation  setup  in  a 
laboratory  environment,  both  the  gimbaled  TASE  camera  and  the  Pan-Tilt  Unit 
hardware  should  be  integrated.  This  will  greatly  improve  the  testing  of  future 
vision-based  algorithms. 
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